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ABSTRACT 



In ;i system for reproducing AY inlbrmnlion from a recording 
medium, such as a DVD, not only are usual titles reproduced, 
but also related information relevant to specific stream infor- 
mation is acquired easily by making use of resources on a 
computer network. In a reproducing system with the function 
of reproducing the title information recorded on a DYI) and 
displaying it on the screen of a display section, when the user 
clicks a Web mark on the screen, the CPU links to a Web 
server on the Internet via a modem and accesses the Web page 
related to the stream information on the screen. At that time, 
the related Web page is the selected information conforming 
to parental information, or attribute information, set in the 
system. 
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AV INFORMATION REPRODUCING SYSTEM 
AND A REPRODUCING METHOD APPLIED 
TO THE SAME SYSTEM 



[0001] This application is a divisional of application Ser. 
No. 10/397,723, filed Mar. 6, 2003, which is a continuation of 
application Ser. No. 09/200,801, filed Nov. 27, 1998, that 
claims the benelil of Japanese Application Nos. 9-328595. 
9-328596, and 10-023282, filed on Nov. 28, 1997, Nov. 28, 
1997, and Feh. 4, 1998, respectively, all of which are incor- 
porated herein by reference. 

BACKGROUND OF THE INVENTION 

[0002] This invention relates to a system for reproducing 
AV information, and more particularly to a reproducing sys- 
tem having an external access function that acquires related 
information connected with the reproduced stream informa- 
tion from resources on a computer network. 
[0003] With the recent development of large-capacity 
DVDs (digital video disks), various reproducing systems for 
making use of multimedia information, including digital 
\ idco information ( including slill pictures i and digital audio 
information, have been proposed. Hereinafter, digital video 
information (including still pictures) and digital audio infor- 
mation are generally called AV information. 
[0004] for example, the reproducing system is an apparatus 
that has a DVD drive and corresponds a video player or a 
video deck with the function of reproducing the AV informa- 
tion recorded on a DVD set in the DVD drive and displaying 
the reproduced information on a television set or the display 
(or screen) of a personal computer. 

[0005] The AV information encoded by a moving-picture 
coding scheme known as the MPEG (moving picture coding 
experts group) 2 is generally multiplexed with audio infor- 
mation and the multiplexed information is recorded on a 
DVD. From the DVD, the reproducing system reproduces 
stream information in specific coding streams (orconsecutix e 
bit data strings) corresponding to the specified title (for 
example, movie), thereby reproducing the AV information on 

[0006] With the recent development of computers and mul- 
timedia technology, various multimedia-compatible com- 
puter systems have been developed. This type of computer 
system is provided with the function of reproducing mm ing 
pictures and audio data as well as text data and graphics data. 
[0007] As multimedia computers have been used widely, 
DVDs have lately attracted attention as a new st< irage medi urn 
to replace the CD-ROM. One side of a single DVD-ROM 
medium can store about 4.7 Gbyte of data, about seven times 
the present CD-ROM. Therefore, about 9.4 Gbyte of data can 
be stored on both sides of the DVD-ROM medium. Use of the 
DVD-ROM medium enables moving pictures, including 
movies containing a large volume of video information, to be 
reproduced w ith a high quality. 

[0008] Recently, there has been a great demand for highly 
sophisticated and profitable information handling, by impart- 
ing! lie interactiveness or responsh eness to digital data of. for 



example, moving pictures, used in the above-described repro- 
duction system or computer system. 

BRIEF SUMMARY OF THE INVENTION 

[0009] An object of the present invention is to provide a 
reproducing system which reproduces AV information from a 
storage medium, such as a DVD, and which is capable of not 
only reproducing normal titles but also easily acquiring 
related information connected w ith specific stream informa- 
tion from resources on a computer network. 
[0010] Another object of the present invention is to provide 
a reproducing system capable of acquiring the optimum 
related information that meets specific conditions, including 
the attributes of the system, when the related information is 
acquired from resources on a computer network. 
[0011] Still another object of the present invention is to 
provide a system which enables DVD video titles to be com- 
bined with the Internet by an effective use and simple expan- 
sion of the DVD standard w ithout changing the standard and 
which realizes a new service where DVD video titles are 
combined with hypermedia contents, such as HTML files, 
provided on the Internet. 

[0012] According to the present invention, there is provided 
a reproducing apparatus comprising: acquiring means for 
acquiring stream data received from a medium and access 
information associated with the stream data; reproducing 
means for reproducing llie acquired stream data: input means 
for accepting an instruction from a user; referring means for 
referring to an external information corresponding to the 
stream data acquired at a point when an input is accepted, on 
the basis of the access information associated with the stream 
data, in the case where there is such an input from the input 
means during the reproduction of the stream data; and out- 
putting means for outputting the external information 
referred by the referring means. 

[0013] According to the apparatus, the user may get not 
only information reproduced from the stream data recorded in 
the medium such as a DVD but also external information 
output by the outputting means. 

[0014] Additional objects and advantages of the invention 
will be set forth in the description which follows, and in part 
will be obvious from the description, or may be learned by 
practice of the invention. The objects and adv antages of the 
invention may be realized and obtained by means of the 
instrumentalities and combinations particularly pointed out 
hereinafter. 

BRIEF DESCRIPTION OF THE SEVERAL 
VIEWS OF THE DRAWING 

[0015] The accompanying drawings, which are incorpo- 
rated in and constitute a part of the specification, illustrate 
presently preferred embodiments of the invention, and 
together with the general description given above and the 
detailed description of the preferred embodiments given 
below, serve to explain the principles of the invention. 
[0016] FIG. 1 is a block diagram of the hardware of a 
reproducing system according to a first embodiment ol the 

[0017] FIG. 2 is a block diagram of a conceptual configu- 
ration of the reproducing system according to the first 
embodiment of the present invention; 
[0018] FIG. 3 conceptually shows the structure of an infor- 
mation management table; 
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[0019] FIG. 4 conceptually show s the structure of an infor- 
mation management table having an attached table: 
[0020] FIG. 5 is a flowchart to help explain the operation of 
the reproducing system of the first embodiment: 
[0021] FIG. 6 is a flowchart to help explain the operation of 
the reproducing system of the first embodiment; 
[0022] FIG. 7 is a flowchart to help explain the operation of 
the reproducing system of the lirst embodiment: 
[0023] FIG. 8 is a flowchart to help explain the operation of 
the reproducing system of the lirst embodiment: 
[0024] FIG. 9 is a flowchart to help explain the operation of 
a reproducing system according to a second embodiment of 
the present invention; 

[0025] FIG. 10A conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0026] FIG. 10B conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0027] FIG. 10C conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0028] FIG. 11A conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0029] FIG. 11B conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0030] FIG. 12 conceptually shows the relationship 
between stream data and specific stream information used in 
the reproducing system of the second embodiment; 
[0031] l'Ki. 13A conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0032] l 'Ki. 13B conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0033] FIG. 13C conceptually shows an example of a dis- 
play screen of the reproducing system according to the sec- 
ond embodiment; 

[0034] FIG. 14 is a flowchart to help explain the operation 
of the reproducing system according to the second embodi- 

[0035] FIG. 15 is a flowchart to help explain the operation 
of a modification of the reproducing system according to the 
second embodiment; 

[0036] FIG. 16isablock diagram ol the basic configuration 
of the hardw are and softw are of an image display apparatus 
according to a third embodiment of the present invention; 
[0037] FIG. 17 is a block diagram of an example of a 
concrete hardware configuration of the image display appa- 
ratus according to the third embodiment; 
[0038] FIG. 18 shows the format of video data used in the 
image display apparatus of the third embodiment; 
[0039] FIG. 19A shows an example of a display screen 
where DVD video is interlocked with HTML contents in the 
image display apparatus of the third embodiment; 
[0040] FIG. 19B shows an example of a display screen 
where DVD video is interlocked with HTML contents in the 
image display apparatus of the third embodiment; 
[0041] FIG. 20 is a flowchart of a first procedure for an 
interlocking display process applied to the image display 
apparatus of the third embodiment; 



[0042] FIG. 21 is a flowchart of a second procedure for an 
interlocking display process applied to the image display 
apparatus of the third embodiment; 

[0043] FIG. 22A shows an example of a management table 
that correlates IDs with URLs used in the image display 
apparatus of the third embodiment; 

[0044] FIG. 22B shows an example of a management table 
that correlates IDs with URLs used in the image display 
apparatus of the third embodiment; 

[0045] FIG. 22C shows an example of a management table 
that correlates IDs with URLs used in the image display 
apparatus of the third embodiment; 

[0046] FIG. 23 A is a flowchart of a third procedure (on the 
server side) for an interlocking display process applied to the 
image display apparams of the third embodiment; 
[0047] FIG. 23B is a flowchart of a third procedure (on the 
client side) for an interlocking display process applied to the 
image display apparatus of the third embodiment; 
[0048] FIG. 24A is a drawing to help explain an example of 
expansion ol a na\ igation command used in the image display 
apparatus of the third embodiment; 

[0049] 1'IG. 24B is a drawing to help explain an example of 
expansion of a na\ igation command used in the image display 
apparatus of the third embodiment. 

[0050] FIG. 24C is a drawing to help explain an example of 
expansion of a navigation command used in the image display 
apparatus of the third embodiment; 

[0051] FIG. 24D is a drawing to help explain an example of 
expansion of a navigation command used in the image display 
apparatus of the third embodiment; 

[0052] FIG. 25A is a diagram to help explain the structure 
of PGC and an example of expansion of a command linked 
with the structure used in the image display apparatus of the 
third embodiment; 

[0053] FIG. 25B is a diagram to help explain the structure 
of PGC and an example of expansion of a command linked 
with the structure used in the image display apparatus of the 
third embodiment; 

[0054] FIG. 25C is a diagram to help explain the structure 
of PGC and an example of expansion of a command linked 
with the structure used in the image display apparatus of the 
third embodiment; and 

[0055] FIG. 25D is a diagram to help explain the structure 
of PGC and an example of expansion of a command linked 
w ith the structure used in the image display apparatus of the 
third embodiment. 

DETAILED DESCRIPTION OF THE INVENTION 

[0056] Hereinafter, referring to the accompanying draw- 
ings, embodiments of the present invention \\ ill be explained. 

First Embodiment 

[0057] FIG. 1 is a block diagram of the hardware configu- 
ration of a reproducing system according to a first embodi- 
ment of the present invention. FIG. 2 is a block diagram of a 
conceptual configuration of the reproducing system. 
[0058] (System Configuration) 

[0059] The reproducing system of the first embodiment is 
assumed to be a personal computer containing a DVD drive. 
[0060] As shown in FIG. 1, the hardware configuration of 
the reproducing system comprises a microprocessor (CPU) 1 
constituting a main control unit, a RAM 2 functioning as a 
work memory (main memory) for the CPU 1, a ROM 3 in 
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which programs forthe CPU 1 and the like are stored, and a 
DVD drive 4. The DVD drive 4 is a storage medium related to 
the first embodiment and is a drive for driving a DVD 40 in 
\\ hiehAY information and an information management table 
(resource use information) are stored. 
[0061] The system further comprises a network connection 
unit that has a communication control section 5 and modem 6 
for connecting to Web servers acting as resources on the 
Internet, an input unit composed of an input control section 7 
and an input section 8, and a display unit composed of a 
display control section 9 and a display section 10. The input 
section 8 has a mouse and a keyboard. The display section 10 
is, for example, a CRT display; a liquid-crystal display, or a 
TV display. 

[0062] (Conceptual Configuration Related to Playback 
Operation) 

[0063] On the DVD 40 in the DVD drive 4 of the first 
embodiment, AV information (hereinafter, referred to as title 
information) 40a and an information management table 40b 
are stored as shown in FIG. 2. The title information 40a is, for 
example, multimedia information, such as movies, and is 
coded stream (consecutive bit data string) information 
encoded by. lor example, the Ml'f ( i-2 mo\ ing picture coding 
scheme. The title information 40a generally includes control 
information conforming to, for example, the DVD standard 
(i.e., management information such as navigation commands 
related to data playback control) as well as the stream infor- 
mation. 

[0064] The information management table 4(1/? is resource 
use information for using resources (assumed to be Web 
servers) on a network (assumed to be the Internet). Specifi- 
cally, as show n in f'Ki. 3. the information management table 
40b is composed of pieces of identification information (area 
information on DVD 40) ST-1 to ST-n, for identifying indi- 
vidual streams in the title information 40a and, access infor- 
mation (or link information) 30. 

[0065] The pieces of identification information ST-1 to 
ST-n include not only information to identify a stream on the 
basis of the DVD standard, including a program chain number 
(a logic unit for reproducing all or part of a title), a video title 
number, a cell number, and a chapter number, but also infor- 
mation on information notice time (hereinafter referred to as 
time information) related to the first embodiment and coor- 
dinate information. The time information is used lor display 
control (the start and end of display ) of a Web mark (specific 
input information) indicating that resources are available in a 
specific piece of the stream information (scene) in the stream 
(in the first embodiment. Web page, can be displayed), as 
explained later. When Web pages can be displayed for all of 
the stream (or when Web pages can be accessed for all of the 
stream), the time information is unnecessary. 
[0066] The coordinate information is used when Web pages 
can be accessed for each set of pieces of section information 
in a specific piece of stream information (moving picture) in 
the stream. Therefore, when the number of Web pages to be 
accessed is one in the specific pieces of stream information, 
the coordinate information is unnecessary. Specifically, as 
shown in FIG. 10B, when the stream information displayed 
on the screen 10a of the display section 10 is treated as pieces 
of section information 92a to 92c. a Web page is prepared for 
each of the pieces of section information 92a to 92c. The 
pieces of section information 92a to 92r are identified on the 
basis of the coordinate information. 



[0067] The access information (link information) 30 is 
information ( URI display related information) to connect to 
resources (Web servers) for accessing a Web page corre- 
sponding lo a specific piece of stream information in the 
individual streams (ST-1 to ST-n) or to the entire stream. For 
example, the system is connected to a Web server correspond- 
ing to the access information (^ n) and a Web page corre- 
sponding to stream ST-n is accessed. 

[0068] furthermore, as shown in 1TG 4. the access infor- 
mation 30 is defined on the basis of parental information 
related to a parental function in system attribute information 
set in the reproducing system. Specifically, the information 
management table 40b has an attached table 40c for defining 
the access information 30 on the basis of the parental infor- 
mation and is designed to select link information (URI dis- 
play related information) on the basis of the parental infor- 
mation and connect the system to the optimum Web server. 
[0069] The parental function is based on a playback control 
(or playback limit) method applied to a digital image infor- 
mation reproducing system. Parental levels are defined as 
parental information related to the parental function, for the 
parental levels, for example, eighl levels are set, ranging from 
the maximum limit level ( level 8 ) to the minimum limit level 
(level 1). The contents to be reproduced in the reproducing 
system are limited on the basis of the set parental levels. 
Specifically, for example, when the maximum limit level 8 is 
set for "Adult" level, the digital image information means 
adult movies. Moreover, for example, when the minimum 
limit level 1 is set for "Child' level, the digital image infor- 
mation means images intended for children. Therefore, with 
the reproducing system, when the parental level set by the 
parental information is, for example, level 7 or lower, the 
digital image information for adult movies with parental level 
8 is inhibited from being reproduced. 
[0070] The information management table 40b is read, as 
shown in FIG. 2, from the DVD 40 under the control of the 
CPU 1 in reproducing the title information and is stored in a 
specific area 20 of the RAM 2. Using the information man- 
agement table 40b stored in the RAM 2, the CPU 1 executes 
the resource use process. Specifically, according to the user's 
specify operation (or the clicking of a Web mark by the user), 
an NT (network) resource use judging section 100 judges 
whether the resource use is valid (i.e., judges whether Web 
page accessing can be done). On the basis of the result of the 
judgment by the judging section 100. an NT resource use 
processing section 101 connects to the relevant Web server on 
the network and accesses the Web page corresponding to the 
related information. Thejudging section 100 and NT resource 
use processing 101 each represent conceptual component 
parts composed of the CPU 1 and set programs. 
[0071] (Title Reproducing Process) 
[0072] Hereinafter, the operation of the first embodiment 
will be explained by reference to flowcharts in FIGS. 5 to 9 
and conceptual diagrams related to display screens in FIGS. 
10 to 13 as well as FIGS. 1 to 4. 

[0073] First, when a DVD 40 has been set in the DVD drive 
4 and the user has entered an instruction to reproduce title 
information from the input section 8. the CPU 1 starts the 
playback process of reading the title information from the 
DVD 40 and displaying it on the screen of the display section 
10 (or starts a playback program). 

[0074] At the beginning of the playback, the CPU 1 reads 
the information management table 40b (including the 
attached table 40c) from the DVD 40 and loads it into the 
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main memory (RAM) 2 (step SI). This enables the CPU 1 to 
read resource use information (also sometimes called WEB 
display related information ) to access the related information 
(or Web page) relevant to each stream in the title in format ion 
to be reproduced. 

[0075] When having confirmed that the title information 
specified by the DVD 40 is present, the CPU 1 reads the 
stream information in stream units ( steps S2. S3). On the basis 
of the information management tabic 40/). the CPU 1 checks 
each stream unit to sec i f the \VI ; B display related in Ion nation 
has been added (step S4). Specifically, if the information 
management table 40b has included no WEB display related 
information, the CPU 1 continues a normal playback process 
without executing the resource use process (NO at step S4. 
and steps S5, S6, and Sll). 

[0076] When the WEB display related information has 
been included in the information management table 40b as 
shown in FIG. 3, the CPU 1 checks the contents of the WEB 
display related information to see if the time information is 
present (steps S7 and S8 1. I f there is no time information, the 
CPU 11 will display a Web mark (also sometimes written as 
a WEB mark) on the screen of the display section 10 in 
reproducing the entire stream (NO at step S8 and step S10). 
This corresponds to a case where the stream information 
corresponding to stream ST-n is reproduced as shown in FIG. 
3. Specifically, as show n in FIG 1 OA. w hen a specific piece of 
stream information 91 has been displayed on the screen 10a 
of the display section 10, a Web mark 90 is displayed on the 
screen 10a. If the time information is present, the CPU 1 will 
execute a timer process for Web mark display control (YES at 
step S8 and step S9). 
[0077] (Web Mark Display Process) 
[0078] The timer process on the basis of the time informa- 
tion will be described by reference to the flowcharts of FIGS. 
6 and 7 and to FIG. 12. 

[0079] The time information is information to specify the 
display time for displaying a Web mark during a display 
period of a specific piece of stream information (correspond- 
ing to a scene enabling resource use, for example, ST-1 in 
FIG. 3) for which a Web page has been prepared. It is assumed 
that stream data items A to ( ' being reproduced consecutively 
as shown in FIG. 12. The specific piece of stream information 
corresponds to a scene corresponding to section B2 of stream 
data B. It is set as information to display a Web mark on the 
basis of the time information. The ( 'I'll 1 starts the timer at the 
reproduce start (at time S) of section B2 and displays a Web 
mark on the screen of the display section 10 (steps S20, S31). 
After the reproduction of section B2 has been completed (at 
time E). control proceeds to a display process for canceling 
the display of the Web mark (steps S30, S31). 
[0080] The timer process on the basis of the time informa- 
tion executes a display process as shown in FIG. 13. Specifi- 
cally, as shown in FIG 13A. stream information 94a in the 
preceding section A is displayed on the screen 10a of the 
display section 10. Following tins, stream information 94b in 
section B is displayed on the screen 10a as shown in FIG. 
13B. At this time, by the timer process, the Web mark 90 is 
displayed on the screen 10a. Thereafter, stream information 
94c in section C is displayed on the screen 10a as shown in 
FIG. 13C. By the Web mark display process, the user can 
check the display of the Web mark 90 on the screen 10a of the 
display section 10 while stream in ft irmation 94b in section B 
is being reproduced. The display of the Web mark 90 suggests 
that the related information (Web page) relevant to the repro- 



duced stream information 94b should be present and able to 
be referred to as the need arises. 
[0081] (Resource Use Process) 

[0082] Hereinafter, the resource use process of the first 
embodiment will be described by reference to flowcharts in 
FIGS. 8 and 14 and to FIG. 11. 

[0083] The basic resource use process without using the 
attached table 40c of FIG. 4 will be described by reference to 
the flowchart of FIG. 8. 

[0084] It is assumed that stream information (or scene) 94 
is being reproduced on the screen 10a of the display section 
10 as shown in FIG. 11 A. The scene 94 is, for example, the 
image where a car is running on a road. When the user clicks 
the Web mark 90 on the screen 10a with the mouse in the input 
section 8. the judging section 100 starts as shown in FICi. 2 
(step. S40). Specifically, the judging section 100 judges the 
validity of resource use on the basis of the information man- 
agement table 40b, that is, judges whether the Web page 
corresponding to the stream information 94 specified by the 
user can be accessed (step S41). 

[0085] When the judging process has shown that specific 
conditions have been fulfilled, the NT resource use process 
section 1 01 starts to execute the resource use process (YES at 
step S42). The specific conditions for validity include the 
presence of the WEB display related information, the state 
where the title is being reproduced, and the presence of the 
access information. 30 corresponding to the stream informa- 
tion 94 specified by the user as the WEB display related 
information. The CPU 1 suspends the process of reproducing 
the present title information (step S43). The stream informa- 
tion present ly being reproduced may be displayed on a win- 
dow 95 on the screen 10a as shown in FIG. 11B. 
[0086] The CPU 1 connects to the Internet via the commu- 
nication control section 5 and modem 6 and accesses the 
specified Web server on the basis of the access information 30 
(step S44). As shown in the flowchart of FIG. 14, after the 
reproduction of the title information has been suspended, the 
modem is started and the CPU 1 is connected to the Web 
server (step S50 to S52). When the resource use process has 
been completed as described later, the reproduction of the title 
in formation, is resumed and the CPU is disconnected from the 
Web server, which completes the connection with the net- 
work (steps S53 to S56). 

[0087] When the CPU 1 has accessed the relevant Web 
server, it receives the Web page (in this case, a home page 
concerning cars for the stream information 94) related to the 
stream information 94 prepared in the Web server. Then, as 
shown in FIG. 11B, the home page 96 is displayed on the 
screen 10a of the display section 10 (step S45). After the 
home page 96 has been displayed, the CPU 1 cancels the 
connection with the NT resource (or Web server) and resumes 
the reproduction of the title information (YES at step S46 and 
steps S47, S48). The display of the stream information 91 
presently being reproduced may be canceled and the home 
page be displayed on the window 93 on the screen 10a. 
[0088] As described above, with the first embodiment, 
while a title is being reproduced on the screen, when the user 
wants to refer to the related information in reproducing spe- 
cific stream information ' in display ing a Web mark I. he or she 
has only to perform a speci fying operation, such as clicking a 
Web mark, to display the Web page corresponding to the 
related information. Therefore, for example, while a running 
car is displayed on the screen, w hen the user wants to refer to 
the related information concerning the car. lie or she can refer 
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to the related information concerning cars immediately. In 
this case, displaying a specific Web mark on the screen 
enables the user lo determine vv hether the related in formal ion 
can be got by linking with the NT resource. 
[0089] (Alternative Configuration of the First Embodi- 
ment) 

[0090] The present invention can be applied not only to a 
reproduction system mainly 1 )\ 1) as described above, but 
also to some other systems. More specifically, the first 
embodiment is described in connection with the case where 
external information is acquired on the basis of the informa- 
tion management table 40b in the reproduction of the title 
information (encoded stream) 40a stored in the DVD 40. 
However, the present invention can be applied to a reproduc- 
tion system designed mainly for TV broadcasting or CATV 
(such a system is also called "set top box" IRD (integrated 
receiver decoder)), which can acquire stream data corre- 
sponding to the title information 40a. Further, in such a repro- 
duction system, it is possible to employ a configuration in 
which the information management table 40b is acquired 
separately from stream data. Alternatively, it is possible that 
the information management table 40b is acquired from a 
medium I for example, smart media) which is different From 
the stream data. 

[0091] It should be noted that in the above alternative 
embodiment, the title information 40 a is supposed to indicate 
image information; however it is not limited to the image 
information. For example, access information is associated to 
the stream data of sound information, and Web can be referred 
to on the basis o the in format ion. so as to output the informa- 
tion on a tune, artist and the like, as external information. 

Second Embodiment 

[0092] Hereinafter, a second embodiment of the present 
invention will be explained. 

[0093] FIG. 9 is a flowchart for the operation of the second 
embodiment of the invention. The operation is related to a 
resource use process using the attached table 40c shown in 
FIG. 4. 

[0094] The processes at step S70 to step S74 are the same as 
those at step S40 to step S44 in the flowchart of FIG. 8 in the 
first embodiment. After the series of processes, the CPU 1 
refers to the attached table 40c of FIG. 4 and checks on the 
basis of parental information lor parental level I to see if more 
than one piece of WEB display related information (or link 
information) is present (step S75). The CPU 1 cheeks the 
parental level set in the system on the basis of the preset 
parental information and selects WEB display related infor- 
mation that coincides with the parental level. The CPU 1 
accesses the relevant Web server and receives the Web page 
(in this case, a home page that coincides with, for example, 
parental levels 0 to .V). the related information prepared in the 
Web server (step S76). The processes at step S77 to step S80 
are the same as those at step S45 to step S48 of the flowchart 
of FIG. 8. 

[0095] On the basis of the parental information included in 
the attribute information on the system set in the system, the 
related information that coincides w ith the parental level can 
be acquired from network resources and referred to on the 
playback screen. Therefore, for example, when the related 
information that coincides with the parental level set in the 
system is not present, it will not be reproduced on the screen. 
In other words, when the parental lev el of the related infor- 
mation is. for example, the adult-oriented maximum level 



"8."' if the parental level set in the reproducing system is "7" 
or lower, the related information will not be reproduced even 
if the user requests. This prevents the related information 
irreverent to the attributes of the system (in this ease, the 
related information that does not coincide with the parental 
lev el ) lrom being accessed and enables the related informa- 
tion conforming w ith the attributes ofthe system to be always 
acquired. 

[0096] (Modification) 

[0097] FIG. 15 is a flowchart related to a modification ofthe 
above-described reproducing system. While in the above 
embodiment, the parental information is used as the attributes 
of the system, information on the user's telephone number is 
used as the attribute information in the modification. 
[0098] As shown in the flowchart of FIG. 15, after the 
process at step S85, the CPU 1 checks on the basis of the 
telephone number information set in the attached table to see 
if more than one piece of WEB di splay related information (or 
link information) is present (step S86). The processes at step 
S81 to step S85 are the same as those at step S70 to step S74 
in the flowchart of FIG. 9. The telephone number information 
is set in the attached table of FIG. 4 in place of the parental 
information (or parental level). 

[0099] The CPU 1 further checks the user-specified tele- 
phone number information set in the system and selects the 
WEB display related information that coincides with the tele- 
phone number (step S87). The CPU 1 accesses the relevant 
Web server and acquires the Web page ( in this ease, the home- 
page from the Web server that coincides with the user-speci- 
fied telephone number), the related information prepared in 
the Web server (step S88). The processes at step S89 to step 
S92 are the same as those at step S77 to step S80 in the 
flowchart of FIG. 9. 

[0100] As described above, with the modification, on the 
basis of the user-specified telephone number information as 
the attributes of the system, the related information is 
acquired from the network resource (that is, the server in the 
area set by the telephone number) that coincides with the 
telephone number and isreferred to on the screen. Therefore, 
for example, when the user-requested related information is 
not present in the servers in the user-specified telephone num- 
ber area, a sen er present in another remote area is prev ented 
from being accessed unconditionally. This enables the user to 
acquire the related information within a reasonable commu- 
nication charge range. 

[0101] In addition to the parental information of the 
embodiment and the telephone number information ofthe 
modification, the present inventionmay be applied to limited, 
access information used as the attribute information about the 
system. The limited access information is used to limit the 
accessing time or period. 

[0102] In the embodiment. theAV information reproducing 
process and the resource use process are realized by the CPU 
1 executing the programs for those processes. The programs 
have been stored in the DVD 40 or another external storage- 
medium and are loaded into the RAM 2. While in the embodi- 
ment, the method of accessing the related information rel- 
evant to the video information in the AV information in NT 
sources has been explained, the present invention may be 
applied to related information relev ant to audio information. 
For example, when the user wants to know the title of the 
music played in the background of a scene, he or she enters 
the data to access the related information relevant to the music 
in NT resources. 
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[0103] As described in detail, with the lirst and second 
embodiments, not only are normal titles reproduced, but also 
the related inlormalion relevant to specilic pieces of stream 
information can be acquired easily by simple operation, mak- 
ing use of resources on a computer network. 
[0104] Furthermore, for example, on the basis of the 
attribute inlormalion set in the system, such as parental inlor- 
malion. only the related inlormalion conforming with the 
atln bu tes o 1 the system can be acquired. This enables the user 
to quickly acquire the lies! related information in reproducing 
normal titles. As a result, various types of information can be 
reproduced. 

Third Embodiment 

[0105] Hereinafter, a third embodiment of the present 
invention will be explained. 

[0106] FIG. 16 shows the basic configuration of hardware 
and software for an image display apparatus according to a 
third embodiment of the present invention. 
[0107] The image display apparatus is used as a digital, 
video player, a set top box, or a personal computer and has the 
function of displaying computer graphics or moving-pictures 
on a special display monitor or a home TV. 
[01 OS] For the main hardware necessary to reproduce the 
DVD video information, the image display apparatus com- 
prises a DVD drive 111 for reading the data recorded on a 
1 )YI ) medium, a Ml'KG-2 decoder 1 12 for decoding the DVD 
video information (video, subpicture, and audio) composed 

0 f MPEG-2 program streams read from the DVD drive 111, a 
VGA controller 113 for controlling a display monitor, a 
remote controller 114, and a communication unit (e.g., an 
ISDN card or a modem) 100 for connecting to the Internet. 
[0109] In the DVD medium, not only nav igation data con- 
stituting a I )VD video title and presentation data 302 but also 
a HTML file for interlocking display with a DVD video are 
stored. The HTML file is used as an initial screen to explain, 
for example, the contents of the DVD video title and is down- 
loaded onto the memory of the image display apparatus. 
[0110] The title playback on the DVD-ROM medium is 
controlled by a DVD playback control program 116. The 

1 )VI ) playback control program 1 16 has the function of inter- 
facing with a WWW browser 117 to display HTML contents 
on a screen, interlocking with the playback of DVD video. 
[0111] The DVD playback control program 116 is actually 
composed of driver groups for controlling the aforemen- 
tioned various pieces of hardware and application programs 
for making title playback using the driver groups. The func- 
tion of the DVD playback control program 116 is classified 
into a navigation manager 201 and a presentation engine 202. 
The navigation manager 201 interprets the navigation data 
301 and the instructions gi\ en by the user and determines how 
to reproduce the presentation data. The navigation manager 
201 also has the function of taking address information, 
including URLs for referring to the locations of the HTML 
contents to be displayed in an interlocking manner out of the 
nav igation data 301 and of reporting it to the WWW browser 
117. URLs referring to the locations of HTML contents 
related to moving pictures are embedded in empty areas of 
navigation packs included, in an MPEG-2 stream in video 
data units of one GOP or two GOPs (from 0.4 sec to 1 sec). 
Whether HTML contents are displayed in an interlocking 
manner is determined by an instruction given by the user. The 
instruction from the user is inputted to the navigation man- 



ager 201 via the remote control dri\ er 1 18. Hie user may gi\ e 
an instruction to the navigation manager 201 by using the 
keyboard or mouse. 

[0112] The presentation engine 202 effects the title play- 
back of moving pictures according to the instruction given by 
the navigation manager 201. 

[0113] The WWW browser 117 is a WWW client for com- 
municating with an outside WWW server using the HTTP 
protocol. Receiving an HTML file from an outside WWW 
server via the communication unit 100, the WWW browser 
1 17 displays it on a screen using a VGA controller 1 13. 
[0114] In the system of FIG. 16, when the user has given an 
instruction to display HTML contents, the navigation man- 
ager 201 takes an URL referring to the location of the HTML 
contents related to the moving picmre presently being repro- 
duced out of the navigation data 301 and reports it to the 
WWW browser 117. As a result, the WWW browser 117 
acquires the HTML contents specified by the URL and dis- 
plays it together w ith the mo\ ing picture on the screen. In this 
case, when the URL has been embedded in empty areas of 
navigation packs as described earlier, this enables hyperme- 
dia information, including the corresponding HTML con- 
tents, to be acquired sequentially through the Internet and 
displayed lor each mm ing picture corresponding to the scene 
being reproduced. 

[0115] Furthermore, the URL, referring to the HTML con- 
tents related to the moving picmre corresponding to the scene 
being reproduced may be taken out of the navigation data 301 
by expanding the navigation commands determined in the 
DVD video standard. A method of embedding the URLs will 
be explained in detail in FIG. 18 or later. 
|()1 16] A concrete system configuration of the image pro- 
cessing apparatus according to the third embodiment will be 
explained. 

[0117] As shown in FIG. 17, the system comprises a PCI 
bus 10, a CPU 11, a main memory (MEM) 12, an HDD 13, a 
DVD interface 16 composed of an ATAPI or SCSI interface, 
an audio controller 17, the DVD drive 111, the DVD decoder 
112, the VGA controller 113, the remote controller 114, and 
the communication unit 100. 

[0118] The DVD driv e 1 1 1 reads the DVl ) video stream 
stored on a DVD medium at a transfer rate of 10.08 Mbps at 
its maximum. The DVD drive 111 is composed of a DVD 
medium, such as an optical disk, a motor, a pickup, a pickup 
drive, a servo controller, and a drive controller including an 
f'CC circuit for detecting and correcting errors. The motor, 
pickup, pickup drive, servo controller, and drive controller 
function as a drive unit for driving a DVD medium and read- 
ing the data recorded on the DVD medium. 
[0119] With the DVD medium, for example, about 135 
minutes of a movie can be recorded on its one side. The main 
images (video), sub-images (sub-pictures) up to 32 channels, 
and sound up to 8 channels (audio) can be included in the 
presentation data constituting the movie information. 
[0120] In the MPEG-2 standard, other coded data can be 
included in the data coded in MPEG-2. Those items of coded 
data are treated as a single MPEG-2 program stream. 
[0121] MPEG-2 is used in encoding video information, 
run-length coding is used in encoding sub-pictures, and 
DOLBY AC 3 is used in encoding audio information. In this 
case, too, the coded video, sub-pictures, and audio are treated 
as a single MPEG-2 program stream. 
[0122] In the MPEG-2 standard, the encoding process is 
based on variable rate coding and therefore, the volume of 
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data recorded or reproduced per unit time can be varied. As a 
result, a high-quality moving picture playback can be 
achieved by increasing the transfer rate of the MPEG streams 
constituting the corresponding frame groups as the scene is 
more violent. 

[0123] FIG. 18 shows an example of the recording format 
for DVD video information used in the third embodiment. 
The recording format conforms to the DVD video standard. 
[0124] As shown in FIG. 18, the volume space of a DVD- 
ROM medium is composed of a volume film structure for 
managing volumes and liles. a DVD \ ideo /one constituting 
] )VI ) \ideo information, and an area for liles other than DVD 
video. In the other files area, HTML files, such as the initial 
screen file, have been stored. 

[0125] The DVD video zone is composed of a video man- 
ager (VMG) and more than one DVD video title set (VTS#1 
to VTS#n). 

[0126] The VMG includes video manager information 
(VMGI), a menu video object set (VOBS), and backup video 
manger information (VMGI). 

[01 27] The VMGT is used as information on the contents of 
all the DVD video title sets present on a DVD medium and 
includes search information on each video title set (VTS) and 
parental attribute information. When the YM( i includes menu 
video object sets (VOBS). the VMGI also includes program 
chain information (PGCI) as information to control the play- 
back of the menu. The PGCI indicates the sequence for repro- 
ducing the cells constituting each menu video object (VOB). 
The title creator can embed the navigation commands (a 
pre-command, a post-command, a button command, or a cell 
command) in the VOB. 

[0128] Theprecommand is a na\ igation command group to 
be executed before the start of the reproduction of cell groups 
(the cells in a PGC) whose reproduction sequence has been 
determined by the PGCI. The pre-command is used for initial 
setting before the reproduction of a PGC . The post-command 
is a na\ igation command group to be executed when all the 
cells in the PGC have been reproduced. The post-command is 
used for a branch process to a PGC to be reproduced next. The 
cell command is a nav igation command group to be executed 
at the time when the corresponding cell in the PGC has been 
reproduced. The cell command is used to reproduce a specific 
cell repeatedly. The button command is a navigation com- 
mand group to be executed at the time when the user has 
decided on a certain button, a choice item on the menu screen. 
The button command is used to execute menu items. 
[0129] Each video title set (VTS) is composed of video title 
set information (VTSI). a menu v ideo object set (VOBS). a 
video object set (VOBS) constituting a title, and a backup 
video title set information (VTSI). 

[0130] The VTSI is playback control information on the 
menu and title in the VTS and includes search information on 
the title and program chain information (PGCI) for managing 
the sequence for reproducing the cells in the menu and title. 
The PGCI also has thena\ igation command (a pre-command, 
a post-command, a button command, a cell command) 
embedded therein. In the PGCI in the VTS, URLs indicating 
the locations of HTML contents related to each scene in the 
title can be embedded. 

[0131] The video object set (VOBS) constituting a title 
includes a large number of video objects called cells (cell #1, 
cell #2, . ..). Each cell is composed of a large number ofvideo 
object units, with a navigation pack (NAM) at the head. Thai 
is. the v ideo object units from one nav igation pack to the next 



nav igation pack constitute a single cell (or a video object). 
The navigation pack is included in video data units of one 
GOP or two GOPs (0.5 sec. to 1 sec). Each navigation pack is 
management information to control the reproduction of the 
corresponding video object and is composed of a disk search 
information I ! )SI ) pack and presentation control information 
(PCI ) pack. The I )SI pack is used as search information for 
the reproduce start address in special playback, such as fast- 
forward or rewind. The PCI pack is used to change angles in 
multiangle playback or to display highlight information for 
executing a navigation command (e.g., a button command) 
according to the instruction given by the user. In the third 
embodiment, a I )RI indicating the I f 1'MI contents related to 
an image o f the corresponding video object is embedded in an 
empty area of a DSI pack or PCI pack. 
[0132] A single cell includes 1 5 frames of information nec- 
essary to reproduce a certain time of moving picture, for 
example, 0.5 sec to 1 sec of moving picture. One cell is 
constructed in GOPs (Group of Pictures) of an MPEG-2 
program stream as described above. In each cell, a video pack 
(V), a sub-picture pack (S), and an audio pack (A) are 
recorded in multiplex form. The v ideo pack (V). sub-picture 
pack (S), and audio pack (A) are data units of coded video, 
sub-picture, and audio, respectively. Although the data si/cof 
each pack is fixed, the. number of packs included in one cell 
is variable. Therefore, the more violent scene a cell corre- 
sponds to, the more video packs the cell includes. 
[0133] In the above format, the VMGI, VTSI, PGCI, PCI, 
and DSI constitute navigation data. The video pack, sub- 
picture pack, and audio pack for each menu and title consti- 
tute presentation data. 

[0134] In the third embodiment, the button command in the 
navigation command embedded in the PGCI or PCI is used as 
a command to specify the URL embedded in the PGCI in the 
corresponding VTS or in the PGCI in the VMG. This makes 
it possible to display a button indicating a link with HTML 
contents on the moving picture screen. When the button has 
been selected, the corresponding I ITMI contents are exter- 
nally acquired by the execution of the command and dis- 
played on the screen. 

[0135] The follow ing is an explanation of each unit in the 
system of FIG. 17. 

[0136] A CPU 11 controls the operation of the entire sys- 
tem. The ( 'PI 1 1 1 executes an operating system and applica- 
tion programs to be executed that are stored in a system 
memory (MEM) 12. The playback of the DVD video titles 
recorded on a I )YI ) medium is started by causing the CPU 1 1 
to execute a DVD playback control program 116. 
[0137] A DVD interface 16 is a peripheral interface for 
connecting a peripheral unit, such as an HDD or a CD-ROM, 
to a PCI bus 10. In the third embodiment, the DVD interface 
16 performs data transfer with a DVD drive 111. 
[0138] An audio controller 17 provides input and output 
control of sound data under the control of the CPU 11. For 
sound output, the audio controller 17 includes a PCM sound 
source 171, an FM sound source 172, a multiplexer 173, and 
a D/A converter 174. The outputs of the PCM sound source 
171 and FM sound source 172 and the digital audio data 
transferred from a DVD decoder 112 are inputted to the 
multiplexer 173. which selects one of them. The function 
corresponding to the D/A converter of the audio controller 17 
is also provided for the DVD decoder 112. Therefore, the 
DVD decoder can output the analog audio signal directly 
v. ithout using the audio controller 17. 
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[0139] The digital audio data is obtained by decoding the 
audio data read from the DVD drive 111. The digital audio 
data is transferred from the DVD decoder 112 to the audio 
controller 17 through an audio bus 18a, not through a P( I bin 
10. This enables the digital audio data to be transferred at high 
speeds without having an adverse effect on the performance 
of the computer system. 

[0140] The DVD decoder 112 reads an MPEG-2 program 
stream via the memory 12 or directly from the DVD-ROM 
drive 111 and separates it into video packets, sub-picture 
packets. and audio packets. It thereafter decodes and synchro- 
nizes each of them and outputs the results. The DVD decoder 

112 includes a transaction control section, an FIFO buffer, 
and an MP] <X i-2 decoderas show n in k'K !. 17. The transaction 
control section causes the DVD decoder 112 to function as a 
bus master (or initiator) Tor issuing a transaction onto the P( '1 
bus 10. It executes a bus cycle for reading an MPEG-2 pro- 
gram stream From the memory 12 or DVD-ROM drive 111. 
The MPEG-2 program stream is sent via the FIFO buffer to 
the MPEG-2 decoder, which separates the stream into video 
packets, sub-picture packets, and audio packets and decodes 

[0141] The decoded audio data is transferred as digital 
audio data through the audio bus 1 St/ to the audio controller 
17 or directly to an external DSP. The decoded video and 
sub-pictures are combined The resulting data is sent as digi- 
tal YIJV data to the digital YIJV input port of a VGA control- 
ler 113. In this case, the digital YUV data is transferred from 
the DVD decoder 112 to the VGA controller 113 through a 
video bus 18b, not through the PCI bus 10. This enables the 
digital YUV data to be transferred at high speeds without 
ha\ ing an ad\ erse e fleet on the performance of the computer 
system, as in the case of digital audio data. 
[0142] For the video bus 18b, a VAFC complying with the 
VESA standard (VESA Advanced feature Connector). VM- 
Channel (VESA Media Channel), S3 LBP interface, or ZV 
port may be used. 

[0143] Under the control of the CPU 11, the VGA control- 
ler 113 controls a CRT display or an LCD used as a display 
monitor for the system. The VGA controller 113 supports 
moving pictures as well as text and graphic representation 
complying with the VGA specification. The VGA controller 

113 includes a graphic display control circuit 191, a video 
display control circuit 192, a multiplexer 193, and a D/A 
converter 194. 

[0144] The graphics display control circuit 191, which is a 
VGA-compatible graphics controller, converts the VGA 
graphic data on a video memory (VRAM) 20 into RGB video 
data. The video display control circuit 192 includes a video 
buffer that stores digital YUV data and a YUV RGB conver- 
sion circuit that converts the YUV data stored in the buffer 
into RGB video data. 

[0145] The multiplexer 193 selects one of the outputs from 
the graphics display control circuit 191 and video display 
control circuit 192 or superposes the DVD video from the 
video display control circuit 192 on the VGA graphics, such 
as the HTML contents, from the graphics display control 
circuit 191 and sends the resulting data to the LCD and D/A 
converter 194. The D/A converter 194 converts the video data 
from the multiplexer 194 into an analog RGB signal and 
outputs the signal to the CRT display. 
[0146] The VGA controller 113 also has the function of 
converting the digital YUV data and audio data into a TV 



signal in the NTSc ' s\ stem and outputting the TV signal to the 
video input of an external TV set. 

[0147] FIG. 19 shows an example of a display screen that 
links the DVD video with the HTML contents. 
[0148] As shown in FIG. 19A, the DVD video provided by 
the DVD playback control program 116 and the HTML con- 
tents provided by the WWW browser 117 are displayed 
simultaneously on the screen. In this state, for example, when 
theuserpressesaWeb display key on a remote control unit to 
specify the interlocking display of 1 1 1M1 contents, or w hen 
the user selects a Web button displayed on a DVD video 
image with a remote control unit, a keyboard, or a mouse, the 
HTML contents related to the moving picture presently being 
reproduced are automatically acquired from an external 
WWW server and displayed on the screen as shown in FIG. 
19B. 

[0149] If the same 1 fl Ml contents have been cached in a 
hard disk, the HTML contents will be displayed on the screen 
without accessing the WWW server. The WWW browser 117 
need not be started beforehand. In this case, with the WWW 
brow ser 1 17 out of operation, only when the user specifies the 
interlocking display of HTML contents with the remote con- 
trol unit, or only when, the user selects the Web button dis- 
played on the DVD video image, the HTML contents related 
to the moving picture presently being reproduced are 
acquired automatically from an external WWW server and 
displayed on the screen. 

[0150] FIG. 19 shows a case where the image of the scene 
being reproduced by the DVD video includes a car. Interlock- 
ing with the image, the letters and images for the specifica- 
tions for the car are displayed as HTML contents. 
[0151] The following is an explanation of a method of 
displaying the DVD video and HTML contents in an inter- 
locking manner. 

[0152] First, a method of giving a URL to a video object 
complying with the DVD video standard and a reproducing 
method in connection with the method will be explained. 
[0153] As explained in FIG. 18, in the DVD video standard, 
a video object is composed of a file group for video objects (or 
video data), management information on the data, and a con- 
trol information file group for describing the playback 
sequence. The video object is an MPEG-2 program stream 
and has PCI and DSL video data management information, as 
a sub-stream. A navigation pack including these is called a 
video object unit, which never fails to exist at the head of one 
GOP or two GOPs (0.5 sec to 1 sec) of video data. Therefore, 
embedding a URL in the reserve area for the PCI or DSI 
makes it possible to specify the Internet address to which the 
stream is related during the playback. 
[0154] The following is an explanation of playback when 
the data is embedded. 

[0155] When the Web button is pressed during the playback 
of the DVD video, the related HTML contents are displayed 
in the sequence shown in the flowchart of FIG. 20. 
[0156] Specifically, when the button is pressed, the DVD 
playback control program 116 acquires a navigation pack 
(NV_PCK) in the video object unit presently being repro- 
duced (step S101). Then, the DVD playback control program 
1 16 judges w hether an Internel address (URL) is present in 
the NV_PCK (step S102). If there is no Internet address, the 
playback is continued (step S103). 

[0157] If an Internet address (URL) is included, the DVD 
play back control program 1 16 will store the position and state 
of the DVD video presently being reproduced audi go into the 
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pause (or halt) state (steps S104, S105). At the same time, the 
DVD playback control program 116 will use the Internet 
address as an argument to start the WWW browser 117 or 
hand over the information as an Internet address to be dis- 
played on the WWW browser 117 in operation (step S106). 
When the WWW browser 117 is closed or when the user has 
specified the start of playback, or after a specific period of 
time has elapsed, the DVD playback control program 116 
restarts the playback of the DVD video. 
[0158] The reason why the playback of the DVD video is 
suspended is to prevent the contents of the DVD video from 
being missed. It is. of course, possible to display the browser, 
while continuing the playback of the DVD video. 
[0159] The following is an explanation of a reproducing 
method when an ID is given to a navigation pack of a video 
object complying w ith the I )YD- VIDEO standard in place of 
the Internet address information (URL). 
[0160] In this case, the URL corresponding to the ID is 
set tsed by referring to a table that correlates the IDs and URLs 
previously downloaded into an external specific server, such 
as that in a pro\ iderl ISP >. or into the image display apparatus. 
The correlating table may be provided in the DVD medium. 
[0161] The processing after the Web button has been 
pressed is effected according to the flowchart of FIG. 21. 
[0162] When the button has been pressed, the DVD play- 
back control program 1 16 first acquires the na\ i gat ion pack 
(NV_PCK) in the video object unit presently being repro- 
duced (step S201) and checks whether the NV_PCK includes 
an ID (step S202). If there is no ID, the playback will be 
continued as usual (step S203). 

[0163] If the NV_PCK includes an ID, the WWW browser 
117 will be used to connect to a previously fixed external 
server, such as a provider and the ID will be sent to the server 
! step S204). The server on the provider side has managed IDs 
and the Internet address information (URLs) related to the 
IDs. It searches for the related Internet address on the basis of 
the ID and automatically acquires the related HTML file. It 
then sends the file to the WWW browser 117, which displays 
the HTML contents (steps S206, S207). When the table that 
correlates IDs with URLs has been downloaded into the 
image display apparatus, the 1 )VD playback control program 
116 acquires a URL from the correlating table and sends it to 
the WWW browser 117. 

[0164] FIG. 22 shows examples of the table that correlates 
IDs w ith the Internet address information (URI s) related to 
the IDs. 

[0165] In FIG. 22A, IDs are correlated with URLs in a 
one-to-one ratio. For example, for the ID TOKYO001, the 
URL "http://www.tokyo.co.jp/ . . . /tosOOl.htm" is searched 
for. 

[0166] In FIG. 22B, more than one URL is correlated to 
eachlD. ForeachID, such a command as searches for an URL 
at the link destination according to conditions is used. 
[0167] In the example of FIG. 22B, "If Today >981231 
Jump 2" means that if Today (the numerical expression of 
today's date) is larger than 98 1231 (98/1 2/31 ). linking is done 
to "hup:/. . . . tos0002.htm" otherwise linking is done to 
"http:// . . . /tosOOOl.htm." Jump 2 means referring to the 
second parameter. 

[0168] Moreover, "If GPRMO >3 Jump 2" means that if the 
value of GPRM[0], one of the general parameters the DVD 
playback control program 116 or image display apparatus 
has. is larger than 3. linking is done to "http:// . . . tos0002. 
htm": otherwise linking is done to "http:// . . . /tosOOOl.htm." 



Transmitting such a general parameter together with the ID 
enables a URL at the link destination to be changed according 
to the nation number registered with the image display appa- 
ratus or the parental level of the DVD video presently being 
reproduced. 

[0169] With the reproducing method, when an ID has been 
acquired, the HTML contents to be read are searched for and 
start to be read in advance. This enables the page for the 
HTML contents to be displayed without delay. FIG. 22C 
shows an example of the table that correlates IDs with URLs. 
In FIG. 22C, the number of pages to be read in advance for 
each ID is paired with the corresponding URL and the pairs 
are managed. 

[0170] For example, for ID=TOKYO0001, "http://' . . . 
/tosOOOl .htm has been registered as the URL for the HTML 
contents corresponding to the scene presently being repro- 
duced. The number of HTML contents related to scenes to be 
reproduced is set at 3. furthermore, "http: ... tos()()02. 
htm", "http:// . . . /tos0003.htm", "http:// . . . /tos0004.htm" 
have been registered as the URLs for the HTML contents, 
respectively. 

[0171] FIG. 23 is a flowchart for the processing when the 
table ofFIG.22C is used. 

[0172] FIG. 23A shows the processing on the server side 
and FIG. 23B shows the processing on the image display 
apparatus side. 

[0173] The DVD playback control program 116 first sends 
an ID (step S401). Receiving the ID, the server starts to search 
for related information on the basis of the II ). searches for the 
I IRI corresponding to the II ) and the 1 1RM1 file specified bv 
the URL. If finding the HTML file, it will transmit the URL 
and HTML file as the related information corresponding to 
the ID to the image display apparatus (steps S301, S302, 
S303). Receiving the URL address, the DVD playback con- 
trol program 116 requests the WWW browser 117 to display 
the HTML file specified by the URL address (steps S402, 
S403). 

[0174] Then, the server gets the number of URI . addresses 
to be read in advance, referring to the table and transmits it to 
the image display apparatus ( step S305 ). Next, if the number 
is not zero, the server will transmit as many URL addresses as 
the number to the image display apparatus (step S305). The 
DVD playback control program 116 receives the number of 
URLs to be read in advance from the serv er. 1 f the number is 
not zero, the DVD playback control program 116 will receive 
the URL addresses and check to see if the HTML files corre- 
sponding to the 1 1R1 s have already been cached in the image 
display apparatus (steps S404 to S407). 
[0175] If they have already been cached in the image dis- 
play apparatus, the I )Y1 ) playback control program 1 16 w ill 
cause the WWW browser 117 to acquire the HTML files 
corresponding to the URLs from the server and cache them in 
the image display apparatus (step S40S). 
[0176] Such ad', a lice reading is not limited to the method of 
registering URLs to be read in advance in the table that 
correlates IDs with URLs. For instance, it may be realized by 
managing a table that correlates the URLs for the HTML files 
corresponding to the scene presently being reproduced with 
the URLs for the HTML files related to the scenes to be 
reproduced, in the server, the image display apparatus, or on 
the DVD medium. Moreover, a plurality of URLs including 
I IR1 ,s to be read in advance may be registered in a navigation 
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[0177] The following is an explanation of a method of 
linking to URLs using the button command. 
[0178] In the DVD video standard, a button can be defined 
by writing in a PCI a rectangle to be highlighted and naviga- 
tion commands to be executed w hen the rectangle is selected. 
The navigation commands do not include a command that 
links to a specified URL. When such a command is defined 
newly, it is possible to link to a certain URL when the button 
is selected. This enable a button (Web link button) for linking 
to a URL to be displayed on the DVD video screen. On the 
screen, when the user selects and decides on the button with 
the remote control unit, the HTML contents corresponding to 
the specilied URL can be displayed. 

[0179] Here, navigation commands in the DVD video stan- 
dard will be explained brielly. 

[0180] The na\ igation command can be used in four types 
of command areas: a pre-command area, a post-command 
area, a button command area, and a cell command area. The 
navigation command in each area is composed of a combina- 
tion of one to three instructions. 

The instructions are roughly classified into the following six 
groups: 

[0181] (1) Goto Instruction Group: More than one naviga- 
tion command can be defined in the pre-command area or the 
post-command area. The Goto Instruction Group is used to 
change the order in which the navigation commands are 
executed. In the area to which the Goto Instruction Group 
belongs, the Goto Instruction Group specifies the number of 
the navigation command to be executed. 
]0182] (2) l ink Instruction (iroup: This instruction speci- 
fies transition in the present domain. 

[0183] (3) .lump Instruction Group: This instruction speci- 
fies transition beyond the present domain. 
[0184] (4) Compare Instruction Group: This instruction 
compares values and, if TRUE, will execute the next instruc- 
tion and, if FALSE, will neglect the values. 
[0185] (5) Set System Instruction Group: This instruction 
specifies the setting of navigation parameters. 
[0186] (6) Set Instruction Group: This instruction is used to 
do specific calculations. 

[0187] A combination of one or more instructions classified 
into six groups makes, a command. There are 15 ways of 
combination. 

[0188] The following methods can be considered to be 
examples of expansion of such na\ igation commands: 
[0189] (Method 1) 

[0190] Expansion of Existing Commands. Such as Jump 
Command 

[0191] FIG. 24A shows a. lump command present in a navi- 
gation command in the DVD video standard. Control jumps 
to a title or a menu by specifying a Jump dest inat ion in a Jump 
operand. FIG. 24B also show s one of the Jump commands. 
Compare & Jump command, which is a command to jump if 
the comparison result has shown TRUE. 
[0192] "Jump URL" command and "EQ & Jump URL" 
command are determined by expanding the Jump commands 
in FIGS. 24A and 24C as shown in FIGS. 24B and 24D. 
[0193] The address at which the URL has been written is 
specified in the operand of the "Jump URL" command or "EQ 
& Jump URL" command. This enables linking to be done to 
the specified location when the button is pressed. Especially 
in the case of "EQ & Jump URL" command, the URL at the 
link destination can be changed dynamically, depending on 
the condition. 



[0194] When the Web link button has been selected, the 
Jump URL" command or "EQ & Jump URL" command are 
executed and the corresponding URL is acquired from PGCI 
and transferred to the WWW browser 117. This enables the 
HTML contents to be displayed. 
[0195] (Method 2) 

[0196] Method of Giving a Broad Interpretation of Infor- 
mation on PGC at the Link Destination by Use of Existing 
Commands 

[0197] Since there is a command which links with a PGC 
for managing the playback order of video objects and speci- 
fies the playback start position, use of the area in which a URL 
has been written as the link destination of the command 
enables the area to be regarded as a PGC. Namely, this method 
is a method of expanding the unit for managing the playback 
order so that the unit may make external connection informa- 
tion, not a video object. This makes it possible to connect with 
the outside world to display other information without 
expanding the existing format so much. 
[0198] FIG. 25A shows the structure of a PGC. FIG. 25B 

show s die structure of Program ( Lain General Information. 

FIG. 25C shows the structure of the PGC Contents of FIG. 
25B. Since there are two bytes of reserved areas, pointers 
indicating the locations in w hich URI s have been w ritten are- 
written as shown in FIG. 25D. 

[0199] This makes it possible to take out the URL and 
acquire the HTML file corresponding to the URL from the 
server and display the file, when a link command to the PGC 
is executed. 
[0200] (Method 3) 

[0201] A Method of Storing a URL Table File Together 
with DVD Video in a DVD Medium and Referring to the URL 
Table Downloaded into the Image Display Apparatus when a 
Nop Command is Executed 

[0202] The navigation commands in the DVD video stan- 
dard include the Nop command, which does nothing. When 
the Nop command has been embedded, the command is deter- 
mined to be a link button to a URL. Each time the button is 
pressed, URLs are acquired one by one from the URL table 
and the HTML file corresponding to the URL is acquired 
from the server and displayed. 
[0203] (Method 4) 

[0204] A method of Allowing the Reproducing Side to 
Ignore All the Button Commands and Refer to a Table 
[0205] The method 4 is a modification of the method 3 . All 
the commands are regarded as ha\ ing the possibility of link- 
ing with URLs and the URL table is referred to. Then, a URL 
is taken out of the URL table. 

[0206] The following is an explanation of a method of 
reproducing the DVD video from an HTML file. 
[0207] The playback at the specified position on the DVD 
video can be effected by navigation commands. Therefore, 
scripting the na\ igation commands enables the DVD video to 
be reproduced directly from the HTML. 
[0208] For a script in the HTML, the following is written 
when a certain button has been pressed: <CallSSFPPGC> 
(meaning that when a medium is loaded, call a PGC to be 
reproduced first (FPPGC) and reproduce it). This enables the 
playback to be resumed as playback is effected when a DVD 
medium is inserted. Specifically, in the method, the playback 
of a DVD medium is controlled on the basis of the displayed 
1 ITM1 file and a tug specifying the play back start position of 
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DVD video is embedded in the HTML script. The method 
also enables interlocking display of DVD video and HTML 

[0209] While in the embodiments, the case where HTML 
contents are acquired from an external server has been 
explained, a plurality of HTML contents may be stored in a 
] )YI ) media beforehand and the contents be displayed, inter- 
locking with the playback of the 1 )YD \ ideo. The function of 
a WWW browser may be incorporated in the DVD playback 
control program 116. 

[0210] Instead of the user requesting the display of HTML 
contents one by one by pressing buttons, all the HTML con- 
tents may be displayed automatically, interlocking with the 
playback of the DVD video. 

[0211] As described above, with the present invention. 
DVD video titles can be combined with the Internet by only 
making effective use of and simple expansion of the DVD 
video standard, without changing the standard. This helps 
realize a new service in which DVD video titles are combined 
with hypermedia contents, such as HTML files provided by 
the Internet. Especially when the method of embedding URLs 
in navigation packs periodically included in a DVD video 
stream is used, this saves the trouble of searching for URLs, 
which improves the performance of real-time display of 
HTML contents. 

[0212] Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, the inven- 
tion in its broader aspects is not limited to the specific details 
and representative embodiments shown and described herein. 
Accordingly, various modifications may be made without 
departing from the spirit or scope of the general inventive 
concept as defined by the appended claims and their equiva- 
lents. 

1-38. (canceled) 

39. A reproduction apparatus comprising: 

means for acquiring stream data and access information 
associated with the stream data from a medium; 

means for reproducing the acqui red stream data; 

means for referring to external information corresponding 
to the stream data being reproduced, on the basis of the 
access information associated w ith the stream data: and 

means for oulputting the external information in synchro- 
nization with the reproduction of the stream data. 

40. The reproduction apparatus according to claim 39, 
wherein said medium is a digital video disk and said stream 
data includes moving pictures recorded on the digital video 
disk. 

41. The reproduction apparatus according to claim 39, 
wherein said means for acquiring includes network commu- 
nication means, which acquires said external information via 
a network on the basis of said access information related to 
each stream data item on said medium. 

42. The reproduction apparatus according to claim 39, 
wherein said access information includes a table provided 
separately from said stream data, the table being read before 
said stream data is reproduced. 

43. The reproduction apparatus according to claim 39, 
w herein said access information includes any one of a pro- 
grain chain number, a video title number, a cell number, and 



a chapter number complying with the DVD standard, and the 
stream data on said medium is specified on the basis of the 
information. 

44. The reproduction apparatus according to claim 39, 
wherein said access information includes duration informa- 
tion to specify at least part of the stream data on said medium. 

45. The reproduction apparatus according to claim 44, 
wherein said duration information is information to inform 
the user of the period during which said external information 
can be acquired. 

46. The reproduction apparatus according to claim 39, 
w herein said access information contains information that is 
used for classifying external information obtained fir each of 
regions obtained by dividing an image thereinto, in a display 
image of stream data displayed on a display. 

47. The reproduction apparatus according to claim 39, 
wherein said access information includes information repre- 
senting coordinates to determine the area of a display screen. 

48. The reproduction apparatus according to claim 3 C ). 
wherein said access information includes parental informa- 
tion to limit display according to parental levels. 

49. The reproduction apparatus according to claim 41, 
further comprising means for reading the next piece ol'aeeess 
information from said medium in advance. 

50. The reproduction apparatus according to claim 41, 
wherein said access information is embedded in an empty 
area in the title information on said medium. 

51. The reproduction apparatus according to claim 50, 
wherein said empty area is an empty area in a navigation pack 
in the DVD standard. 

52. The reproduction apparatus according to claim 51, 
wherein said empty area is DSI and PCI in a navigation pack 
in the DVD standard. 

53. The reproduction apparatus according to claim 51. 
wherein said empty area is PGCI and PCI in a navigation pack, 
in the DVD standard. 

54. The reproduction apparatus according to claim 51, 
wherein said empty area includes URL information. 

55. The reproduction apparatus according to claim 51, 
wherein said empty area includes ID information replaceable 
with URL information. 

56. The reproduction apparatus according to claim 55, 
further comprising means lor acquiring IIRI information on 
the basis of said ID information. 

57. The reproduction apparatus according to claim 56, 
wherein more than one piece of URL information is corre- 
lated to said ID information. 

58. The reproduction apparatus according to claim 56, 
further comprising means for selecting said URL informant >n 
on the basis of date data, general parameters, nation codes, 
and parental levels. 

59. The reproduction apparatus according to claim 55, 
wherein more than one URL is correlated to said empty area. 

60. The reproduction apparatus according to claim 59, 
further comprising means for updating said URI . information 
on the basis of date data, general parameters, nation codes, 
and parental levels. 



